Evaluation of Diagnostic and Triage Accuracy and Usability of a Symptom Checker in an Emergency Department: Observational Study.

BACKGROUND: Symptom checkers are clinical decision support apps for patients, used by tens of millions of people annually. They are designed to provide diagnostic and triage advice and assist users in seeking the appropriate level of care. Little evidence is available regarding their diagnostic and triage accuracy with direct use by patients for urgent conditions. OBJECTIVE: The aim of this study is to determine the diagnostic and triage accuracy and usability of a symptom checker in use by patients presenting to an emergency department (ED). METHODS: We recruited a convenience sample of English-speaking patients presenting for care in an urban ED. Each consenting patient used a leading symptom checker from Ada Health before the ED evaluation. Diagnostic accuracy was evaluated by comparing the symptom checker's diagnoses and those of 3 independent emergency physicians viewing the patient-entered symptom data, with the final diagnoses from the ED evaluation. The Ada diagnoses and triage were also critiqued by the independent physicians. The patients completed a usability survey based on the Technology Acceptance Model. RESULTS: A total of 40 (80%) of the 50 participants approached completed the symptom checker assessment and usability survey. Their mean age was 39.3 (SD 15.9; range 18-76) years, and they were 65% (26/40) female, 68% (27/40) White, 48% (19/40) Hispanic or Latino, and 13% (5/40) Black or African American. Some cases had missing data or a lack of a clear ED diagnosis; 75% (30/40) were included in the analysis of diagnosis, and 93% (37/40) for triage. The sensitivity for at least one of the final ED diagnoses by Ada (based on its top 5 diagnoses) was 70% (95% CI 54%-86%), close to the mean sensitivity for the 3 physicians (on their top 3 diagnoses) of 68.9%. The physicians rated the Ada triage decisions as 62% (23/37) fully agree and 24% (9/37) safe but too cautious. It was rated as unsafe and too risky in 22% (8/37) of cases by at least one physician, in 14% (5/37) of cases by at least two physicians, and in 5% (2/37) of cases by all 3 physicians. Usability was rated highly; participants agreed or strongly agreed with the 7 Technology Acceptance Model usability questions with a mean score of 84.6%, although "satisfaction" and "enjoyment" were rated low. CONCLUSIONS: This study provides preliminary evidence that a symptom checker can provide acceptable usability and diagnostic accuracy for patients with various urgent conditions. A total of 14% (5/37) of symptom checker triage recommendations were deemed unsafe and too risky by at least two physicians based on the symptoms recorded, similar to the results of studies on telephone and nurse triage. Larger studies are needed of diagnosis and triage performance with direct patient use in different clinical environments.

Implementation and maintenance of an emergency department naloxone distribution and peer recovery specialist program.

STUDY OBJECTIVE: Emergency department (ED)-based naloxone distribution and peer-based behavioral counseling have been shown to be feasible, but little is known about utilization maintenance over time and clinician, patient, and visit level factors influencing implementation. METHODS: We conducted a retrospective cohort study of an ED overdose prevention program providing take-home naloxone, behavioral counseling, and treatment linkage for patients treated for an opioid overdose at two Rhode Island EDs from 2017 to 2020: one tertiary referral center and a community hospital. Utilizing a Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework, we evaluated program reach, adoption, implementation modifiers, and maintenance using logistic and Poisson regression. RESULTS: Seven hundred forty two patients were discharged after an opioid overdose, comprising 966 visits (median: 32 visits per month; interquartile range: 29, 41). At least one intervention was provided at most (86%, 826/966) visits. Take-home naloxone was provided at 69% of visits (637/919). Over half (51%, 495/966) received behavioral counseling and treatment referral (65%, 609/932). Almost all attending physicians provided take-home naloxone (97%, 105/108), behavioral counseling (95%, 103/108), or treatment referral (95%, 103/108) at least once. Most residents and advanced practice practitioners (APPs) provided take home naloxone (78% residents; 72% APPs), behavioral counseling (76% residents; 67% APPs), and treatment referral (80% residents; 81% APPs) at least once. Most clinicians provided these services for over half of the opioid overdose patients they cared for. Patients were twice as likely to receive behavioral counseling when treated by an attending in combination with a resident and/or APP (adjusted odds ratio: 2.29; 95% confidence interval, 1.68, 3.12) compared to an attending alone. There was no depreciation in use over time. CONCLUSIONS: ED naloxone distribution, behavioral counseling, and referral to treatment can be successfully integrated into usual emergency care and maintained over time with high reach and adoption. Further work is needed to identify low-cost implementation strategies to improve services use and dissemination across clinical settings.

Viral Coinfection is Associated with Improved Outcomes in Emergency Department Patients with SARS-CoV-2.

INTRODUCTION: Coinfection with severe acute respiratory syndrome-coronavirus 2 (SARS-CoV-2) and another virus may influence the clinical trajectory of emergency department (ED) patients. However, little empirical data exists on the clinical outcomes of coinfection with SARS-CoV-2 METHODS: In this retrospective cohort analysis, we included adults presenting to the ED with confirmed, symptomatic coronavirus 2019 who also underwent testing for additional viral pathogens within 24 hours. To investigate the association between coinfection status with each of the outcomes, we performed logistic regression. RESULTS: Of 6,913 ED patients, 5.7% had coinfection. Coinfected individuals were less likely to experience index visit or 30-day hospitalization (odds ratio [OR] 0.57; 95% confidence interval [CI], 0.36-0.90 and OR 0.39; 95% CI, 0.25-0.62, respectively). CONCLUSION: Coinfection is relatively uncommon in symptomatic ED patients with SARS-CoV-2 and the clinical short- and long-term outcomes are more favorable in coinfected individuals.

Race, ethnicity, and emergency department post-overdose care.

BACKGROUND: Emergency department (ED) visits for opioid-related overdoses continue to rise across the United States, particularly among Black, Latinx, and American Indian/Alaskan Native communities. A minority of people with opioid use disorder (OUD) engages in formal addiction treatment and there are racial disparities in treatment access. ED visits for opioid overdose are crucial opportunities to link individuals with OUD to harm reduction and treatment services. However, we know little about whether racial inequities exist in ED treatment after opioid overdose. METHODS: This observational, cross-sectional study examined differences in services provided to overdose patients who were discharged after an ED visit for opioid overdose by patient race-ethnicity. Primary outcomes included provision of take-home naloxone, ED-based behavioral counseling, and linkage to treatment. Race-ethnicity differences in post-overdose ED services were evaluated using chi-square analyses, and multivariable logistic regression analyses were conducted to examine associations of race-ethnicity with receiving post-overdose services, controlling for other institutional-, provider-, and patient-level factors. RESULTS: From September 2017 to February 2020, 734 patients were discharged from the ED for an opioid-related overdose. Most patients were White non-Latinx (70.0%), 8.9% were Black non-Latinx, 3.3% were Other race non-Latinx, and 18.0% were Latinx. Take-home naloxone was the most frequent intervention provided to patients while behavioral counseling was the lowest across all race-ethnicity categories. There were no statistically significant differences in provision of take-home naloxone and treatment referral based on patient race-ethnicity. However, a lower proportion of discharged Black non-Latinx patients received behavioral counseling compared to patients of other race-ethnicities, and the odds of receiving behavioral counseling was significantly higher for White non-Latinx (OR: 1.75; 95% CI: 1.00, 3.06); Latinx (OR: 2.06; 95% CI: 1.05, 4.06); and Other race non-Latinx (OR: 3.29; 95% CI: 1.18, 9.15) patients compared to Black non-Latinx patients. CONCLUSION: Black non-Latinx patients discharged from the ED for an opioid-related overdose were less likely to receive behavioral counseling compared to non-Black patients. Possible reasons for this decreased provision of behavioral counseling include provider bias, patient mistrust of the medical and behavioral health care systems, and limited provider training in addiction medicine and motivational interviewing. These inequities add to the known racial disparities in ED patient care. Further research should elucidate barriers to behavioral counseling within ED settings and factors contributing to racial inequities in post-overdose emergency care.

Boarding is Associated with Reduced Emergency Department Efficiency that is not Mitigated by a Provider in Triage.

INTRODUCTION: Boarding of patients in the emergency department (ED) is associated with decreased ED efficiency. The provider-in-triage (PIT) model has been shown to improve ED throughput, but it is unclear how these improvements are affected by boarding. We sought to assess the effects of boarding on ED throughput and whether implementation of a PIT model mitigated those effects. METHODS: We performed a multi-site retrospective review of 955 days of ED operations data at a tertiary care academic ED (AED) and a high-volume community ED (CED) before and after implementation of PIT. Key outcome variables were door to provider time (D2P), total length of stay of discharged patients (LOSD), and boarding time (admit request to ED departure [A2D]). RESULTS: Implementation of PIT was associated with a decrease in median D2P by 22 minutes or 43% at the AED (p < 0.01), and 18 minutes (31%) at the CED (p < 0.01). LOSD also decreased by 19 minutes (5.9%) at the AED and 8 minutes (3.3%) at the CED (p<0.01). After adjusting for variations in daily census, the effect of boarding (A2D) on D2P and LOSD was unchanged, despite the implementation of PIT. At the AED, 7.7 minutes of boarding increased median D2P by one additional minute (p < 0.01), and every four minutes of boarding increased median LOSD by one minute (p < 0.01). At the CED, 7.1 minutes of boarding added one additional minute to D2P (p < 0.01), and 4.8 minutes of boarding added one minute to median LOSD (p < 0.01). CONCLUSION: In this retrospective, observational multicenter study, ED operational efficiency was improved with the implementation of a PIT model but worsened with boarding. The PIT model was unable to mitigate any of the effects of boarding. This suggests that PIT is associated with increased efficiency of ED intake and throughput, but boarding continues to have the same effect on ED efficiency regardless of upstream efficiency measures that may be designed to minimize its impact.

Evaluating the Impact of Hospital Closure on Local Emergency Department Operations.

BACKGROUND: The January 1, 2018 closure of Memorial Hospital of RI (MHRI) has anecdotally resulted in operational strain for the area's remaining EDs. This study seeks to evaluate the impact on neighboring facilities. METHODS: An interrupted time-series analysis was conducted to compare operational outcomes and demographics pre- and post-MHRI closure. Three hospitals were selected from the same health system: Miriam Hospital, Rhode Island Hospital, and Newport Hospital. RESULTS: In the first 12 months following MHRI's closure, there were significant increases in monthly ED volume, length of stay, and left without being seen rates at two area hospitals. There was also a significant diversification of the patient population at these sites. The most substantial impact was noted at Miriam Hospital, the closest remaining facility. CONCLUSION: This study demonstrates operational strain and an evolving patient population at neighboring EDs following MHRI's closure. These findings suggest the need for additional resource allocation to support clinical care and logistics.